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Based on an effective Hamiltonian specified in the triangular lattice with possible p x ± ip y - or 
d x 2_ y 2 ±id xy -wa.ve pairing, which has close relevance to the newly discovered Nao.3sCo02-yH20, the 
electronic structure of the vortex state is studied by solving the Bogoliubov-de Gennes equations, 
ft is found that p x ± ip y -wa.ve is favored for the electron doping as the hopping integral t < 0. 
The lowest-lying vortex bound states are found to have respectively zero and positive energies for 
p x ±ip y - and d x i_ y i ±id xy -w&ve superconductors, whose vortex structures exhibit the intriguing six- 
fold symmetry. In the presence of strong on-site repulsion, the antiferromagnetic and ferromagnetic 
orders are induced around the vortex cores for the former and the latter, respectively, both of which 
cause the splitting of the LDOS peaks due to the lifting of spin degeneracy. The microscopic STM 
and the spatially resolved NMR measurements are able to probe the new features of vortex states 
uncovered in this work. 
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The recent discovery of superconductivity in the Co 
oxide, Nao.35Co02-j/H 2 1], has intrigued much inter- 
est on its novel properties especially the similarities to 
and differences from the high-T c copper oxides. Super- 
conductivity occurs after sodium content is reduced in 
Nao.75Co02 and the distance between the C0O2 planes 
is enlarged by hydration, indicating that the supercon- 
ductivity is mostly relevant to the two-dimensional C0O2 
layer similar to the role of CuC>2 layers in cuprates. Fur- 
thermore, the Co 4+ atoms in neutral (undoped) C0O2 
plane has spin-i, resulting in the parent compound a 
spin-i antiferromagnet. On the other hand, because the 
spins form a triangular lattice, the antiferromagnetism is 
frustrated and the resonating-valence-bond (RVB) state 
might give rise to superconductivity under proper dop- 
ing. At present, the mechanism of the superconductiv- 
ity in this material is hotly debated and accordingly the 
pairing symmetry of the superconducting order parame- 
ter (OP) has been paid significant attention although still 
controversial. Theories 0- [J based on the RVB the- 
ory support the view that the superconducting OP has 
the spin-singlet broken-time-reversal-symmetry (BTRS) 
chiral d x i_ y i ± id xy symmetry, while theories based on 
a combined symmetry analysis with fermiology 0] and 
numerical calculations of normal state electronic 
structure speculate that the OP is spin-triplet BTRS 
chiral p x ± ip y -w&ve symmetry. The experimental re- 
sults reported by different groups using the same nuclear- 
magnetic-resonance(NMR) technique are also confusing: 
one group [9j supports the spin-triplet p x + ip y -wave sym- 
metry while another group claimed to support the 
spin-singlet s-wave symmetry. 

In this Letter, to have valuable clues for experimental 
clarification, we elucidate and compare the effects of the 



two most possible pairing symmetries, p x + ip y $l LD, |3] 
and d x 2_ y 2 + id xy 000jwaves, on the electronic struc- 
ture of the vortex state. In particular, we shall answer 
two crucial questions clearly: (i) what are the new fea- 
tures of the vortex state in this kind of triangular sys- 
tem? (ii) what are the experimentally observable signa- 
tures showing the differences between the mentioned two 
pairing symmetries? Because the mechanism of the su- 
perconductivity in Nao.35Co02-yH20 is still unclear at 
present, we will not adopt the well-known t-J model as 
in Refs. 00 as it only gives rise to the spin-singlct 
pairing. Here the well-established t-U-V Hubbard model 
is employed with competing magnetic (U) and su- 
perconducting (V) interactions. Although phenomeno- 
logical, this model captures the rich physics of system 
with competing orders and has been applied to study 
the field-induced antiferromagnetic and charge-density- 
wave (CDW) orderings around the vortex core of high-T c 
d-wave cuprates 12], having accounted for several impor- 
tant experimental observations. Considering similarities 
of this new superconductor to the cuprates as well as 
possibilities of both spin singlet and triplet pairings, we 
extend this model to study the superconducting cobalt 
oxide with either spin singlet or triplet pairing channel 
in the triangular lattice and examine the novel properties 
in the vortex state. The effective model Hamiltonian is 
expressed as 

H cS = - (tij4* c i° + h.c.) + J2(Un l9 - p)4 a c la 

(i,j)cr i,a 
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where rii a = (c^Cjo-) is the electron density with spin 
a. p is the chemical potential. ± is for spin triplet 



and singlet pairings, respectively and the pairing po- 
tential Afj is denned as A* = \{{c%-\Cj\) ± { c H c tf))-> 
which comes from a mean field treatment of the pair- 
ing interaction V J2(i,j) ( c \] c ]i c i] c ]i + 4i c l] c *l c jl )- In 
an external magnetic field, the hopping integral ty can 
be written as = texp(iipi t j) for the nearest-neighbor 
(NN) sites where ifiij = J* 3 A(r) • dr with 

A(r) the vector potential and $o = hc/2e the super- 
conducting flux quantum. The internal field induced by 
supercurrents around the vortex core is neglected since 
Nao.35Co02-j/H 2 can be treated as extreme type-II su- 
perconductors according to experiment |l3| estimation. 
Therefore, A(r) is approximated as (0, Bx, 0) in a Lan- 
dau gauge where B is the external magnetic field. By ap- 
plying the self-consistent mean-field approximation and 
performing the Bogoliubov transformation, diagonaliza- 
tion of the Hamiltonian iJ g can be achieved by solving 
the following Bogoliubov-de Gennes (BdG) equations: 
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FIG. 1: 3D and contour plots of the spatial distribution of 
the dominant |A Px+lp "| (a) and the induced subdominant 
|AP*-ipy| (b) The blue parallelogram in (a2) denotes the 
28 x 56 MUC in our study. See text for detail. 



where u n ,v n are the Bogoliubov quasiparticle ampli- 
tudes with corresponding eigenvalue E n . Hij i(T — 



-tij + 5 %J (Un is - fi) with 
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subject to the self- 



consistent conditions: 



Now we address the vortex lattice structure of 
the gauge-invariant A p * ±iPy and A d * 2 -y 2±tdxy accord- 



ing to A^±^(r0 = £ ff A+ e 



E n {K|l - f(En)] with f(E) the Fermi distribu- A d * 2 -y 2±idxy fa) = Y, s A 



tion function. A 



In this work, we choose such a magnetic unit cell 
(MUC), which accommodates two superconducting flux 
quanta 2$o^3| an d is characterized by Ri = N&i and 
R,2 = 2N&2 with N an integer, ai = a(V3/2, 1/2) and 
a 2 = a(0, 1) are the prime translation vectors of the C0O2 
triangular lattice. By introducing the magnetic Bloch 
states labelled by the quasimomentum, we can handle 
an array of MUC's under the modified periodic bound- 
ary condition related to the phase factor by magnetic 
translations x( r , R) = — 27rmy — 7r(m — 2n + m 2 /2) with 
R = mRi + 71R2. In addition, we set t < l la accord- 
ing to the analysis on the band calculation ■ The 
energy and length will be measured in units of \t\ and the 
lattice constant a. 

It is noteworthy that the coexistence of and 
competition between superconductivity and ferromag- 
netism(FM)/antiferromagnetism(AFM) in this novel ma- 
terial is very interesting and important, but quite com- 
plicated even in the homogenous case. We leave it for fu- 
ture careful investigation. In the present work, we focus 
only on the vortex state, bearing in mind that magnetic 
orders may be induced in the vortex cores where super- 
conductivity is significantly suppressed. In the homoge- 
nous superconducting state, we find that the p x ± ip y - 
wave pairing state is always favored for h > 1 while the 
d x 2_ y 2 ± id X y-w&ve case is stablized for 0.5 < n <l|l5j 
with h the average electron number per site. 
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/6 and 
/6, where i+ 

5 denotes the six NN sites of the site i. The energy degen- 
eracy of A Px±lPy is lifted in the presence of magnetic field 
and the A Px+lPy is energetically favored when the field 
is applied along z, resulting in A Px+lPy (r) — |A(r)|e~ l * 
(winding number -1). Combining with our further iden- 
tification of such behavior in the d x i_ y i ± id xy -w&ve case 
where d x 2_ y 2 +id xy is favored, it indicates that the inter- 
nal phase winding of the Cooper pairs will try to coun- 
teract the phase winding of the vortex to save the energy 
cost of supercurrents. To study the vortex lattice struc- 
ture of A Pw+lPy , we select a favorable electron occupancy 
f; = 1.2 and V = 1.6, giving rise to the bulk value of 
A Px+lp « = 0.043. Such a small OP value results in a gap 
opened at Ac a p = 0.14 with a large core size accord- 
ing to the estimation fc^£ ~ 2Ep / 'vrAcap — 27. Figure 
shows the spatial distribution of the dominant A Px+%p v (r) 

compo- 



together with the induced subdominant A 
nent, both with obvious six- fold symmetry. Because the 
magnitude of A Px+lPy is small, it is sensitive to the mag- 
netic field, resulting in a large modulation of the magni- 
tude of OP. The induced subdominant A Pm ~ lPy is about 
one third of A Pw+ ' lPy . The spatial structure of the sub- 
dominant A p *~ lPy has some peculiar properties as dis- 
played in Figs.^bl) and (b2) which has not been shown 
before to our knowledge. We find that in addition to the 
original vortices (OV) [small green disks in Fig. db2), 
with winding number +1], inter- vortex vortices (IW) 
[green triangles in Fig. ^b2), with winding number -1] 
are generated within every three OV. Therefore, each OV 
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FIG. 2: 3D (a) and contour plots (b) of the spatial distribution 
of |A d * 2 -* a+Wa "'|. The MUC here is 20 x 40. 
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FIG. 3: The LDOS of p x + ip y - (a), d x 2_ y 2 + id xy -wa,ve (b) 
vortex lattice without ferromagnetic order (U=0) at the vor- 
tex center (red lines), NN site of vortex center (green lines), 
next NN site of vortex center (blue lines) and midway of two 
nearest vortices (black lines). V = 2, n = 1.2 for (a); and 
V — 1.3, n = 0.67 for (b). The thermal broadening tempera- 
ture is 0.02. 



is surrounded by six IVV and each IVV by three OV and 
three IVV. The IVV forms honeycomb vortex lattice with 
length of the side -j= of that of the OV lattice. A similar 
behavior has also be found for the d x 2_ y 2 ± id xy -w&ve 
case. For larger gap values, we study the vortex lattice 
structure of A d * 2 -y 2±ld:iy . We choose the electron occu- 
pancy fi = 0.67 and V = 1.3, which leads to the bulk 
value of A d * 2 -y 2+ld *v = 0.10 (A Gap = 0.4). The spatial 
pattern of \A d ^-y 2+td:cy (r)| is shown in Fig. The sub- 
dominant A d ~' ld (not shown here) has a similar structure 
to A P:c ~ lPy [Fig.^b)] and the IVV also forms honeycomb 
vortex lattice structures. 

The local density of states (LDOS) as a function of 
energy of the two pairing states are displayed in Fig. [3] 
with definition p^E) = - EJ u h ?f( E n ~ E ) + 
|t?"i | 2 /'(.E„ + E)], which is proportional to the differ- 
ential tunnelling conductance observed in scanning tun- 
nelling microscopy (STM) experiments. For clarity, we 
set V = 2.0 with n — 1.2 to enlarge the p x + ip y -wa.ve 
OP (AP* +z Py = 0.09) and V = 1.3 with n = 0.67 for 
the d x 2_ y 2 + id xy pairing state so that the gaps opened 
by them are comparable. Note that the LDOS of the 
Px + «Pj,-wave pairing state is much lower than that of the 
d x 2_ y 2 + id xy -wave case because the chemical potential 



is sitting on the electronic spectrum position where the 
density of states of the normal state is low. In the mid- 
way between two NN vortices, the LDOS resembles that 
in bulk: both the chiral p x + ip y -wave and d x 2_ y 2 + id xy - 
wave pairing states open full gaps. Consequently, the 
low-lying quasiparticle bound states emerge within the 
gap as expected, similar to the conventional s-wave vor- 
tex core states 16J. However, the energies of the low- 
est core states in the vortex center of both the p x + ip y 
and d x 2_ y 2 + id xy -~wa,ve pairing states deviate the ap- 
proximate relation E\ = —A^/Ep (Note that t < 0) 
for conventional s-wave superconductors. E\ of p x + ip y 
vortex is zero (pinned on the Fermi level) while that 
of d x 2_ y 2 + id xy -wave vortex positive (above the Fermi 
level). The difference of the bound state energy between 
Px + ipy- and d x 2_ y 2 + id xy -~wa,ve vortex states is non- 
trivial and is intrinsic to the internal angular momentum 
l z of the Cooper pairs. For the p x + ip y -w&ve state, the 
quasiparticle wave functions u and v have angular mo- 
mentum reflecting the total effect of the phase winding -1 
of vortex and l z = 1 of Cooper pairs, which accordingly 
gives rise to a bound state with strictly zero energy |l7| . 
Similarly, for the Cooper pair (l z = 2) with d x 2_ y 2 + id xy - 
wave pairing symmetry [lj|, u has and v -1 angular 
momentum thus with a positive bound energy p^j. This 
novel difference of vortex core bound states between the 
two gapped chiral p x + ip y and d x 2_ y 2 + id xy -wave pair- 
ing state can be observed by STM experiments with high 
energy resolution and might help to identify the pairing 
symmetry in this material. 

We then study the induced magnetic moment around 
the vortex core by examining the magnetization defined 
as M s (ri) = n^—riii and its dependence on U and n. For 
the electron-doped case, we find that in the presence of 
on-site repulsion the frustrated AFM moment might be 
nucleated near the core for small doping as analogy to the 
case of cuprates. The magnetic moment at the p x + ip y - 
wave vortex core, M™ re , as a function of U with h = 1.2 
and fi = 1.3 is shown in Fig. 0{al) with fixed V = 2.0. 
The critical value U cr increases while M™ re decreases 
with h and we find no magnetic moment for large doping 
with n — 1.4 up to f = 5. And larger V also results 
in larger U CT because superconductivity competes with 
magnetism. For the hole-doped region with fi < 0.8, a lo- 
calized FM (instead of AFM) moment is induced around 
the d x 2_ y 2 +id xy -w&ve vortices, completely different from 
the picture of field-induced AFM order in high-T c d-wave 
superconductors. Fig. EJbl) displays the U dependence 
of Af s corc for n = 0.6 and n = 0.7. Contrary to the elec- 
tron doped case, larger doping gives rise to weaker U CT 
and stronger magnetic moment. We find that these seem- 
ingly surprising results have little relevance to the pairing 
symmetry, but are intrinsic to the competition between 
the AFM and FM orders in our model. The AFM state 
dominates the region near the half filling, while the FM or 
paramagnetic metallic states dominates the region near 
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FIG. 4: (al): The induced AFM moment at the p x + ip y - 
wave vortex core M^ 010 as a function of U for n = 1.2 (red) 
and n — 1.3 (green). (a2): The spatial structure of M a with 
n = 1.2 and [7 = 5. (bl): The induced FM moment at the 
d x -2_ y 2 + id X y-wa,ve vortex core M™ c as a function of U for 
n — 0.6 (red) and n — 0.7 (green). (t>2): The spatial structure 
of M s with n = 0.7 and [7 = 3. 



state in the p x +ip y -wave vortex state and a localized FM 
state in the d x 2_ y 2 ±id xy -wave case. The local electronic 
structure and induced magnetic orders in the vortex state 
might be observed by the microscopic STM|l9| and the 
spatially resolved NMR|20| probes with high resolution. 

In finalizing this Letter, we noticed that Zhu and Bal- 
atsky [2lJ addressed a similar issue with taking into ac- 
count only the d x 2_ y 2 ±id xy -wave pairing. To our under- 
standing, at least the following major considerations and 
conclusions are quite different from theirs: (i) we com- 
pared two superconducting states with different pairing 
symmetries and found that when n — 1.35 [corresponding 
to the n — 0.65 for t > in their paper] the ground state 
is p x ± ip y -wave pairing state, rather than d x 2_ y 2 ± id xy 
state; (ii) we found the AFM order induced in the core 
of the p x + ip y -w&ve vortex (U — 5) and localized FM 
order (U = 3) in the d x 2_ y 2 ± id xy -w&ve vortex and pre- 
dict that the splitting of the LDOS peak by both of the 
magnetic orders; (iii) we chose the triangular vortex lat- 
tice matching the triangular C0O2 lattice, with the vor- 
tex structure exhibiting the intriguing six-fold symmetry, 
while they studied the square vortex lattice. 

We thank Y. Chen for useful discussions. This 
work was supported by the RGC grant of Hong 
Kong(HKU7075/03P), the 973-project of the Ministry 
of Science and Technology of China under Grant Nos. 
G1999064602, and the NSFC grants 10204011, 10204019, 
and 10021001. 



the Van Hove singularity(0.5 < n < 1). The profiles of 
M 8 for the p x + ip y -w&ve vortex state with AFM mo- 
ment and the d x 2_ y 2 + id xy -w&ve case with the FM mo- 
ment are displayed in Fig. 0Ja2),(b2). Fig. 0{a2) shows 
clear staggered AFM manner of M s with slow decay while 
(b2) FM manner with exponential decay away from the 
core. Different from the charge density waves (CDW) 
with periodic modulations 4a in d-wave cuprates[l2j, we 
find the Friedel oscillation of the electron density for the 
AFM case. As expected, both the AFM and FM or- 
ders cause the double-peak splitting of the LDOS peaks 
around the vortex center due to the lifting of the spin 
up-down degeneracy as shown in Fig. EIa3), (b3). Such 
splitting of the LDOS associated with the vortex bound 
states opens a symmetric {p x + zp y -wave case) or asym- 
metric (d x 2_ y 2 + id xy -weive case) subgap with respect to 
the Fermi level, which provides a remarkable signal for 
the STM probing of possible magnetic orderings in this 
material. 

To summarize, we have investigated the novel vortex 
state of Naa;Co02-?/H20 with two possible pairing sym- 
metries realized in the 2D triangular lattice. Besides the 
intriguing spatial structure of the vortex, we also find 
signature in the electronic structure of the vortex state 
associated with different pairing symmetries. In the pres- 
ence of strong on-site repulsion, we find frustrated AFM 
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